Fluctuations of entropy production in the isokinetic ensemble 
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We discuss the microscopic definition of entropy production rate in a model of a dissipative system: 
a sheared fluid in which the kinetic energy is kept constant via a Gaussian thermostat. The total 
phase space contraction rate is the sum of two statistically independent contributions: the first one 
is due to the work of the conservative forces, is independent of the driving force and does not vanish 
at zero drive, making the system non-conservative also in equilibrium. The second is due to the work 
of the dissipative forces, and is responsible for the average entropy production; the distribution of its 
fiuctuations is found to verify the Fluctuation Relation of Gallavotti and Cohen. The distribution 
of the fluctuations of the total phase space contraction rate also verify the Fluctuation Relation. It 
is compared with the same quantity calculated in the isoenergetic ensemble: we find that the two 
ensembles are equivalent, as conjectured by Gallavotti. Finally, we discuss the implication of our 
results for experiments trying to verify the validity of the FR. 
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I. INTRODUCTION 

A very important concept in the theory of out-of-equilibrium stationary states induced by the appUcation of a 
driving force (temperature or velocity gradients, electric fields, etc.) to a system in contact with a thermal bath is 
that of entropy production rate \^ 2^ . In usual nonequilibrium thermodynamics it is defined as the power dissipated 
by the driving force divided by the temperature of the bath jj] : 

i 

Here Xi{t) is the driving force (e.g. the electrical field or the temperature gradient) and Ji{t) its conjugated flux (the 
electrical current or the heat flux respectively). 

The Probability Distribution Function (PDF) of the total entropy production over a time r is defined as 



P^(cr) = P(^J^ dt &{t) = (J 



(2) 



If we set — 1, o'(<) has the dimension of an inverse time and a is dimensionless. Then, in the limit of large t, the 
function Prio') is expected to verify the Fluctuation Relation (FR) in the following form: 

Pri-a) = e-^ Pria) , (3) 

if \cr/ (a) I < C, being C a positive constant. Having fixed C, the correction at finite r is of order one in the exponent of 
the right side of Eq.O (while a is of order r if 7 ^ 0). The FR states that the probability to observe a negative entropy 
production (over a large enough time interval) is exponentially smaller than the probability to observe the same value 
with positive sign. This relation has been first observed numerically in a sheared fluid |^ and subsequently proven 
to hold for reversible systems by Gallavotti and Cohen under the chaotic hypothesis, a strong chaoticity assumption 
for the dynamics of the system, leading to the demonstration of the Fluctuation Theorem (FT) 5]. Gallavotti then 
showed that in the limit of small driving forces the FT implies the usual Green-Kubo relations and the Fluctuation- 
Dissipation Theorem , thus clarifying the deep physical significance of Eq. O Despite the hypothesis of the FT 
are strictly verified only for very special systems, the FR has been shown to be valid for a large class of dissipative 
systems in very different conditions „&. 10.. , 1 1. ..12.] . Some experimental attempts have also been done in order to 
check its validity for real systems llsTllilllsl . 
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The verification of Eq. 13 in microscopic models for dissipative systems requires a microscopic definition of o'(i). 
In the case of conservative models, in which the phase space volume is conserved in absence of drive, the entropy 
production rate has been identified at the microscopic level with the phase space contraction rate [J, 0i B ll^ • One 
can ask if the same identification holds for models in which the phase space volume is not conserved even in absence 
of the driving force. 

It has been conjectured by Gallavotti that, if the entropy production rate is properly defined, equivalence of 
ensembles should hold, in the sense that the FR must hold for a subsystem of the (big) dynamical system under 
consideration, at least for a large class of thermostatting mechanisms, including irreversible and stochastic ones 

In this paper we will discuss two different models of thermostat, both mechanical and reversible (then, we will not 
discuss the problem of equivalence between reversible and irreversible thermostats), defining two different ensembles: 
the first one is constructed in order so that the total phase space contraction rate vanishes in equilibrium, while in the 
second one fluctuations of the total phase space contraction rate are present even in the limit of zero driving force, 
thus making the system non-conservative also in equilibrium. We will then discuss the equivalence of these ensemble 
and the possibility of identifying the entropy production rate with the phase space contraction rate when the latter 
is not vanishing in equilibrium. 



II. TWO MODELS OF A MECHANICAL THERMOSTAT 

We consider a well known microscopic model for a sheared fluid defined by the SLLOD equations 

1 = ^ + IViX , 

[ Pi^ Fi- jpyiX - a{p, q)pi , 

where Fi are conservative forces, Fi — —dq-V{q). The terms proportional to 7 (the shear rate) impose to the liquid a 
flow along the x direction with a gradient velocity field along the y axis. In this model the driving force is the velocity 

gradient 7, and its conjugated fiux is the yx component of the stress tensor, Py^- The function a{p, q) is a Gaussian 

2 

thermostat, and can be defined in order to conserve either the total energy H{p, q) — J2i 5^ + ^il) or the kinetic 
energy alone. The total phase space contraction rate for this system is given by: 

The second term is of order one in the case we will discuss, and will be neglected with respect to the first term. 



1. Isoenergetic (or microcanonical) ensemble 
Imposing the constraint dH/dt = 0, one gets the following expression for a: 



X^r^P xiPyi + mF^iy, 

The expression for the phase space contraction rate is then: 



aH{p,q) = -i — 2 • (6) 



(^h{p, q) = iNanip, q) = - '^^^-t^tX^ = ^-y^P^ ' C^) 

T{p) 

where T(p) = 3^7 7^,, - ~^ and Pyx{p,q) — ^iiPxiPyi/m + F^iyi) is the microscopic expression of the yx component 
of the stress tensor . Note that in this case the phase space contraction rate is exactly equal to the microscopic 
expression of Eq. ^ From Eq. we see that in the isoenergetic ensemble the phase space volume is conserved in 
equilibrium as &h is vanishing for 7 = 0. The behavior of the fluctuations of cth has been discussed in 0| where the 
vahdity of the FR for Pt{<Jh) was observed for the first time. 
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2. Isokinetic ensemble 



If the temperature T{p) has to be conserved instead of the total energy, one obtains the foUowing expression for a: 

a-Tip^q)^— ^ 2 -=ag(p,g)+ ' ^ , (8) 

Pi Pi 

and the total phase space contraction rate is given by 

. / ^ iPyxjp, q) , E» q^P^ ■ ( \ , ■ ( \ ln\ 

<7T{p,q)^ + y^^^^ =(^i[p,q)+<yc{p,q) . (9) 

From the previous expression one sees that the total phase space volume contraction rate in the isokinetic ensemble 
is the sum of two different contributions: the first one ((i^) is due to the work of the dissipative forces and has the 
same microscopic expression as in the isoenergetic ensemble (see Eq. O; the second one {&c) is the power dissipated 
by the conservative forces divided by the temperature. It is easy to see that it the second term can be also written as 
ac{p,q) = —T~^{p) '^'^Jf'' ; thus, it has zero average (because the total potential energy is constant in average). This 
term is present also in equilibrium (7 = 0): then, in the isokinetic ensemble, the phase space volume is not conserved 
also in equilibrium, at variance to what happens in the isoenergetic ensemble. However, the two ensembles are known 
to be equivalent in equilibrium |3J. 



3. Ensemble equivalence in nonequilibrium 

Having defined these two model of thermostat, two questions naturally arise: 

1) One can ask if the proper definition of &{t) (i.e. the one that verifies the FR) in the isokinetic ensemble is given 
by the total phase space contraction rate &t or by &^ alone; 

2) Once a definition for the entropy production rate in the isokinetic ensemble has been chosen, one can compare the 
distribution of its fluctuation with the same quantity calculated in the isoenergetic ensemble, thus verifying if some 
kind of nonequilibrium ensemble equivalence holds [ij, |2| • 

To address this points, we will check numerically the validity of the following statements: 
i) &^ and &c defined in Eq. |21are statistically independent in the isokinetic ensemble; 

a) the PDF of &c is 7-independent in the range of 7 explored, i.e. the fluctuations of the power dissipated by the 
conservative forces are closely the same in and out of equilibrium; 

Hi) the PDF of is the same in the isokinetic and in the isoenergetic ensemble for any value of r, therefore P^laj) 
verifies the FR in both ensembles; 

iv) the large r limit for P^^a^) (condition for the validity of the FR) is attained for r > IO^Tq,, being Tq the decay 
time of the stress correlation function; 

v) in the isokinetic ensemble, at large r, the fluctuations of &t are completely dominated by the dissipative part a^, 
and Pr{crT) tends to Pr{cr^): thus, Pr{(JT) also verifies the FR. However, this happens for r values IO'^Tq,) much 
greater than the ones needed to observe the FR for Pr{cr^). 

From the above statements it follows that Gc acts as a "noise" superimposed to a^. It does not contribute to the 
average entropy production, and contributes to its fluctuations only for small r. 



III. DETAILS OF THE SIMULATION 



The investigated system is a binary mixture of N=QQ particles (33 type A and 33 type B) of equal mass m 
interacting via a soft sphere pair potential Vapir) = e I ^"^^ j ; a and (3 are indexes that specify the particle species 

(q!,/3 e [A, _B]). The potential is cut and shifted at r^p — 1.5((Tq, + crp) as usually done in Molecular Dynamics 
(MD) simulations UH. The small size of the system is mandatory in order to obtain the large fluctuations of entropy 
production needed to test Eq. 13 A common choice for the particle radii is ct^/ctb = 1.2 ^19j . All the quantities are 
then reported in units of m, e, and the "effective radius" CTq = [{2aAY + 2(0-^ + ctbY + (2cb)^]/4. The particles are 
confined in a cubic box, at density p = 1 , with periodic boundary condition adapted to the presence of a shear flow. 
The SLLOD equations are integrated via a standard velocity- Verlet algorithm that approximates the exact equation 
of motion up to o{dt^) The integration step is chosen to be dt — 0.002 in order to have a very good energy (or 
temperature) conservation over long times. 
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FIG. 1: Probability distribution functions of CTc for different values of r in equilibrium and for 7 — 0.05: for each value of r, 
filled symbols correspond to 7 = 0, open symbols to 7 = 0.05. On the y axis the number of counts in each bin of the histogram 
is reported. A Gaussian distribution (non reported) perfectly describes all the curves in the range of fluctuations accessible to 
our simulation. The width of the distribution does not depend on r. 



Three very long simulation runs (10^ MD steps, corresponding to t — 2 - 10^) have been performed in order to have 
good statistics also for r ~ 10^ MD steps: the first one at equilibrium (7 — 0) in the isokinetic ensemble at T = 0.5, 
the second one in the same ensemble at the same temperature with 7 = 0.05, and the third one in the isoenergetic 
ensemble with E = 3.3, that corresponds to {T{p)) ^ 0.5, and 7 = 0.05. 



IV. CONSERVATIVE FORCES 



First, we study the PDF of &c{t) in the isokinetic ensemble. In Fig. ^the function Pr{ac) is reported for different 
values of r (from 0.2 to 2000) in equilibrium and for 7 = 0.05. The two sets of distributions are observed to coincide 
over the whole time range accessible to our simulations. Thus PricTc) is 7-independent and statement ii) is verified. 
At any time the distributions are well described by a Gaussian form 



Pr{<Jc) oc exp 



(10) 



in the range of values of CTc accessible to our simulation. From the fit of the data reported in Fig. ^ we find that 
- within the statistical accuracy - the mean value of CTc is vanishing, as expected (see the discussion after Eq. |3 . 
Moreover, recalling that 



dt 



dV{q) _ V{Q) - Vir) 



dt 



T 



we find 



y2 



rp2 



(11) 



(12) 



where the last equality holds for large t. In our simulation S1{t) is observed to be r-independent and equal to 
2((V'^) - {y)'^)lT'^ (i-e. to the fiuctuations of the potential energy) in the whole investigated r range. 
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FIG. 2: Pr{ a^) as a function of a^jm^ at T = 0.5 and 7 = 0.05: for each value of r filled symbols correspond to the isokinetic 
ensemble, open symbols correspond to the isoenergetic ensemble. Ensemble equivalence holds for this quantity for any value of 
r. The distributions are Gaussian over the whole accessible range. 



V. DISSIPATIVE FORCES 



We turn now to the analysis of the PDF of a~f(t), the entropy production due to the work of the dissipative forces. 
This quantity is reported in Fig. El for T — 0.5 and 7 = 0.05 in both the isokinetic and isoenergetic ensemble. The 
PDFs in the two ensembles are found to coincide within the statistical uncertainties: thus, ensemble equivalence holds 
for the fluctuations of a-y at any r, proving the validity of statement Hi). 

In the isoenergetic ensemble, the distribution Pr{a-y) has been shown to verify the FR P|, so we expect that the FR 
is also verified in the isokinetic ensemble for t long enough. In Fig. Owe report log P-rlaj) / Pr{—(Jj) as a function of 
a J calculated in the isokinetic ensemble. The FR predicts that the curve must be a straight line with slope 1. From 
Fig. Owe see that while for short r values log PT{a'y)/Pr{—a'y) appears to be linear but has a slope different from 
one, on increasing r the slope tends toward one and the FR is indeed verified for r ^ 8. 

From Fig. Owe can also observe that, similarly to that of &c{t), the PDF of Ojy(t)is Gaussian over a very wide 
range. The same behavior has been observed and discussed in previous works 0, IM Il2| . For a Gaussian distribution. 



Pt{tj) (X exp 



(r) 



, the FR can be expressed as a relation between the mean value and the variance: 

2m^ = 5*2 . (13) 



In the inset of Fig. the quantity 2to^/S'^ is reported as a function of r. For t < 20 it coincides with the slope of 
log PT-icr-y) / Pt^—ct-^) as a function of a-y as derived from the main panel of Fig. O For r 20 in our simulation it is 
not possible to observe negative values of and the function logPr{o'y)/PT-{~a-y) cannot be evaluated. However, 
the quantity 2m^/5^ can be calculated also in absence of negative values of and is found to be equal to one within 
the statistical accuracy. In the inset of Fig. the autocorrelation function of the entropy production ((T^(r)(T-y(0)) is 
also reported as a function of r. This quantity, from Eq. |(7J), is proportional to the stress autocorrelation function 
C(r) = {Pyx{T)Pyx{0))- By defining the relaxation time of stress fluctuations as C{Ta) — C(oo) = |[C(0) — C(oo)], 
for the values of 7 and T analyzed here we have Tq '^0.1. From the inset of Fig. Owe note that the FR is verified for 
r ^ IO^Tq, which is statement iv). 
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FIG. 3: logP,K)/P,(- a^i) as a function of cr^ for different values of r in the isokinetic ensemble. The FT predicts the slope 
to be 1 (continuous line) and is verified for r > 8. In the inset ^m^jSi^ (the slope of the lines) is reported as a function of t 
together with the stress autocorrelation function (rescaled by an arbitrary factor). 



VI. TOTAL PHASE SPACE CONTRACTION RATE 



To conclude the analysis of the simulation data, we will now discuss the behavior of the fluctuations of the total 
phase space contraction rate, given by the sum of the two previously discussed contributions. Its PDF (not shown 

here) is also well described by a Gaussian distribution P^[aT) cx exp — ^°'^25^(r)"''^ range of ctt accessible 

to our simulation. To relate the distribution of ctt to the ones of and a-y, it is sufficient to discuss the behavior 
of the corresponding variances. In fact, remembering that nic — 0, — ttit — 1.39t and all the distributions are 
Gaussian in the observed range, the three distributions are fully specified by their variances. In Fig. ^ we report the 
variances S*^, and as a function of r. In the inset, is reported as a function of 5^ + S'^ parametrically in r. 
From Fig. 2] we deduce that CTc and cr^ are statistically independent, as the variance of their sum is the sum of their 
variances, thus verifying statement i). Then, as ctt = cFc + cr-y, its distribution is the convolution of the distributions 
of CTc and cr^. We observe also that S*^ is time- independent, while = 2m^ = 2.78t as predicted by the FR. Then, 
the fluctuations of the total entropy production are dominated by the conservative part at short times and by the 
dissipative part at long times. We have 



Pr(ac) 



for small r (< 5) 
for large r (> 1000) 



(14) 



This implies that the FR, being verified for Pt{(j^)^ is verified also for the PDF of the total entropy production ctt, 
but for much longer times (r > 1000 ^ IO'^Tc), and verifies statement v). Note that in our simulation it is not possible 
to directly check the validity of the FR in the asymptotic regime for ar because it is not possible to observe negative 
values of over so long times, so that the validity of the FR has to be deduced assuming a Gaussian form for the 
distribution Pt-((7t) and checking that the ratio 2tot/5'|. is equal to one. However, by looking to the fluctuations of 
the dissipative part alone, the asymptotic regime is easily reached and a direct verification of the FR in the isokinetic 
ensemble is possible. Note also that the asymptotic regime for ar corresponds to a regime in which the fluctuations 
due to the dissipative part are dominant and gt ~ a-y. 
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FIG. 4: Variances of CTc, f-y and or as a function of r. In the inset, Sj- is reported as a function of + S^; the data agree 
perfectly with the straight line of slope 1: then, a-y and (Tc are statistically independent. The fluctuations of ar = o"7 + o"c are 
dominated at short times by ac and at long times by a-,. 



VII. FLUCTUATION RELATION FOR A GAUSSIAN DISTRIBUTION 

It is interesting to discuss briefly the implication of the FR if the distribution Pt(o') is Gaussian 0,|3|- In this case, 
the FR is equivalent to Eg. 1131 and we can easily rewrite, using Eq. Qand time-translation invariance: 

"^7^ = ~J,{Pyx)T 



S'^ir) = ^ / dt dt' {Py.{t)Py,{t')) = ^ I dt C{t) 



Then, Eq. 1131 can be written in the following form 
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Py.) = -j; I dt C{t) (16) 



iP ) 

or, defining the viscosity r; = — ^ . 



ri=^f^dtC{t) 



(17) 



This (for r — > 00) is an example of the well known Green-Kubo relation for the transport coefflcients, that is strictly 
valid only in the 7^0 limit. Thus, if the distribution P^^a^) is a Gaussian, the FR implies the validity of the 
Green-Kubo relation for the viscosity also at finite 7. 



VIII. CONCLUSIONS 



We discussed a simple model of a driven non-conservative system, i.e. a system in which the phase space volume is 
not conserved in equilibrium: a sheared liquid in the isokinetic ensemble. 
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We have shown that the total phase space contraction rate is the sum of two statisticahy independent contributions, 
defined in Eq. |^ the first, d^, is due to the work of the dissipative forces, and is the microscopic equivalent of 
the thermodynamic definition of entropy production given in Eq. ^ Its PDF is found to be the same in the two 
considered ensembles for any value of r, and verifies the FR in the large t limit, t IO^Tq,. The second contribution 
is 7-independent, has zero average and is negligible in the (very) large r limit, t > 10'^Tq,. 

Then, we can conclude that: 

a) The total entropy production can be identified, in the isokinetic ensemble, with the total phase space contraction 
rate ctt- The equivalence of isokinetic and isoenergetic ensembles holds, as conjectured in 1, 2, 16, 17J. However, 
very large values of r, such that the contribution of dc can be neglected, have to be reached. 

b) li one looks at that part of the phase space contraction rate that vanishes in the equilibrium limit, namely (i-y, 
equivalence holds for any r and the FR is found to be verified at shorter times (by a factor 10^). 

Obviously the first definition of entropy production rate has general validity j^l, while the second one has to be 
discussed case by case by identifying the "relevant" part of the total phase space contraction rate. However, the second 
definition turns out to be very useful on a practical ground, because the very large r values needed to observe the 
validity of the FR for the total phase space contraction rate are difficult to be reached in computer simulations. Also, 
this observation is relevant for experiments on real systems: indeed, equilibrium fluctuations of entropy production 
(analogous to cTc) are always present in real system in contact with a thermal bath, and it is impossible to separate 
the two contributions as in a numerical experiment. In planning experiments, one has then to check carefully that 
the time scales involved are such that the contribution analogous to dc is negligible. 

It is a pleasure to thank Giovanni Gallavotti for a careful reading of the manuscript and for interesting suggestions 
and comments, and Alessandro Giuliani for useful discussions and encouragement. 
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